Papers with multilingual setups
Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for training language-vision models only consider monolingual learning, especially English. |
| Approach: | They propose to extend an English language-vision model into a multilingual and code-mixed model by using knowledge distillation techniques. |
| Outcome: | The proposed model outperforms existing models on multilingual and code-mixed VQA datasets on eleven languages. |
Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to modularity are limited to the case of pre-trained modules in a pre-training language model. |
| Approach: | They propose a method that allows the transfer of pre-trained PEFT modules between incompatible PLMs without any change in the inference complexity. |
| Outcome: | The proposed method allows the transfer of modules between incompatible PLMs without any change in the inference complexity. |